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Nonexistence of nonconstant solutions of some degenerate 
Bellman equations and applications to stochastic control 

Martino Bardi, Annalisa Cesaroni, Luca Rossi * 


Abstract 

For a class of Bellman equations in bounded domains we prove that sub- and super¬ 
solutions whose growth at the boundary is suitably controlled must be constant. The 
ellipticity of the operator is assumed to degenerate at the boundary and a condition 
involving also the drift is further imposed. We apply this result to stochastic control 
problems, in particular to an exit problem and to the small discount limit related with 
ergodic control with state constraints. In this context, our condition on the behavior of 
the operator near the boundary ensures some invariance property of the domain for the 
associated controlled diffusion process. 


1 Introduction 

We consider the fully nonlinear elliptic operator 

F[u\ := sup (—6(x, a) ■ Du(x) — tr (a(x, a)D^u(x))) , (1) 

aeA 

which is usually called Hamilton-Jacobi-Bellman (briefly, HJB). Here “tr” denotes the trace 
of a matrix. Our first main result is in some sense a counterpart for a bounded domain 
H C of results of Liouville type in the whole space. We assume that F degenerates at the 
boundary of fi, at least in the normal direction to dfl, for some a G A, and that the quantity 
b{x,a) ■ Dd{x) + tr(a(x, a)L)^d(x)) is positive near dO, where d{x) is the distance of x from 
dVl. This is related with the viability, or weak invariance, of H for the controlled diffusion 
process associated with the operator F. We show that any viscosity subsolution u of F[u\ = 0 
in H such that 

m(x) = o(—log(d(x))) as X —)• dH, (2) 

must be constant. A similar result holds for supersolutions under a stronger condition on the 
coefficients near the boundary related to the invariance of the associated diffusion process for 
all controls. 

Results of nonexistence of nonconstant solutions in unbounded domains for elliptic equa¬ 
tions are usually called Liouville-type theorems. For fully nonlinear equations they have been 
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studied in the last ten years by several authors, see, e.g., [18], [20|, and the references therein. 
They are very different from our result for various reasons. In particular, in our case the drift 
term compensates the degenerate ellipticity of F at the boundary, whereas in the unbounded 
case with uniformly elliptic F the drift term represents a difficulty. 

The main application of our Liouville-type results concerns the well-posedness of the so- 
called ergodic Hamilton-Jacobi-Bellman equation 

sup (—6(x, a) • Ilx(x) — tr(a(x, a)Zl^x(x)) —/(x, a)) = c, x E H. (3) 

qGA 

The unknowns here are (c, y) E M x (7(11). Under mild continuity and boundedness assump¬ 
tions on the data and the non-degeneracy condition in the interior of H 

a(x, a) > 0 for every x E H and a E H, (4) 


we prove that this problem has a solution, the additive eigenvalue c is unique, and the viscosity 
solution X is unique up to the addition of constants among functions u satisfying the boundary 
condition ©• 

There are several motivations for the above mentioned results, especially from stochastic 
optimal control. Here we give two applications, in Sections [S] and 16.21 respectively. The first 
concerns an exit time problem for the controlled diffusion 


dX^- = b{Xf -, at)dt + V2ct(X"' , at)dWt 
X"- = X E n. 


where a. E is the control. There is a well-known link between the associated value function 
V and the HJB operator F given by ([I|) with a := 2aa'^ (see, e.g., [23]). Using our Liouville- 
type result we show that n is a constant that, under suitable conditions, we can explicitly 
compute. 

The second application concerns the so-called small discount limit. Letting (nA)A>o be 
the infinite-horizon discounted value functions: 


v\{x) 


inf E 
a.&A 



e-^H{X^-,at)dt , 


X E H, 


where X"' solves ([5]) and I is bounded, we prove that AnA(x) —>■ c and v\{x) —vx{x) x{x) as 
A ^ 0 locally uniformly, where (c, x) solves the ergodic HJB equation ([3]) and x is any point 
in H. This is related with the ergodic control problem for stochastic processes, where c is the 
optimal cost in the minimisation of the limit of T“^E[ ^(X“' , at)dt^ as T —>■ -|-oo, and Dx 

allows to synthesise an optimal feedback (at least in principle, under further assumptions). 
There is a large literature on this topic, see [25] dU [TUJ [TT] for diffusions reflected at the 
boundary and Neumann boundary conditions in ©, [ad] for periodic boundary conditions, 
and the recent monograph [2], as well as the references therein. Some of the cited papers deal 
with the model problem 


— An-b —/(x) = c, in H, 

for p > 1, which is a special case of Q with unbounded drift b and running cost I, see, 
e.g., [25] • Lasry and Lions [2^ showed that, in the case 1 < p < 2, the problem is uniquely 
solvable, up to constants, under the boundary condition 


n(x) —>■ -boo as X ^ dQ. 
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They use the small discount approximation (see also m), and show the connection of the 
singular boundary condition with stochastic control under state constraints. 

A related result on the small discount approximation for linear operators with singular 
drift was obtained in where it is considered in particular the following problem 

Xu{x) — -^ 7 ^ • Duix) — aAu — f{x) = 0, in Q, 
d{x) 

under the assumptions A > 0, b{x) ■ Dd{x) > a > 0 and h{x) ■ t{x) = 0 for every x G dVL and 
every r(x) tangential vector to 90 at x. The authors prove the existence of a C'^(0)nlT^’°°(0) 
solution of such problem, which is the unique C'^(Q) solution such that (Ol) is satisfied (see 

m Thm 6]). 

Here, differently from 1281 EH EZ], we make the assumption that b{x, a) is bounded, so 
F[u] grows at most linearly in Du and is not necessarily coercive. On the other hand we make 
assumptions on the coefficients b and a at the boundary that imply an invariance property 
of the domain such that the control problems of reflected diffusion and state constraint are 
essentially equivalent. Our weaker boundary condition ([2|) fits this context. Our assumptions 
on b and a near dXl are related to the characteristic boundary points for linear operators |22] 
and to the irrelevant points for the generalized Dirichlet problem Hums]. They also arise in 
the recent work [15] on the generalized principal eigenvalue and the Maximum Principle for 
degenerate operators such as F. 

Let us mention two additional sources of interest for the ergodic PDE Q that we do 
not develop here. The first is the theory of homogenisation and singular perturbations for 
fully nonlinear equations. In that context ([3|) is called the cell problem, the constant c allows 
to define an effective Hamiltonian for the limit PDE, and y is called the corrector and is a 
fundamental tool for proving the convergence, see, e.g., [T] and the references therein. The 
second is the asymptotic behavior as f —)• +oo of solutions of the evolution equation 

ut + sup (—6(x, a) ■ Du — tr(a(x, a)D‘^u) — l{x, a)) =0, x G H, f > 0, 
a£A 

with initial datum u{x,0) = uo{x). In several cases, such as periodic boundary conditions, it 
is known that u{x,t)/t -A c as t ^ +oo, where c is the constant solving ([3]), a fact also related 
to ergodic stochastic control, see, e.g., mm- In some cases it can be proved, more precisely, 
that u{x,t) — ct ^ xi^): see, e.g., [T2|. The validity of these results with the boundary 
condition (Ej) will be the subject of further investigations. 

The paper is organized as follows. In SectionElwe list the precise assumptions and state the 
two main results of the paper. Section[3]is devoted to the construction of a strict supersolution 
to F[u] = 0 with suitable boundary behavior, that plays the role of a Lyapunov function, first 
when dQ is of class and then when it is nonsmooth under further assumptions on E. In 
SectionElwe prove the non existence of non trivial sub and supersolutions to F[u] =0 for 
dXl smooth and nonsmooth. Section [S] deals with the stochastic control problem with exit 
times. In Section [6] we first prove the well posedness of the ergodic HJB equation Q and 
then interpret the result within stochastic control theory as a vanishing discount limit. 
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2 Main results 


Throughout the paper we will assume, if not otherwise stated, that fl be a bounded connected 
open set in M"' with (7^ boundary. Let d{x) be the signed distance function from i.e. 

d{x) := dist(x,M"\n) — dist(x,n). (6) 

We know, from e.g. [241 Lemma 14.16], that d is of class in some neighborhood of the 
boundary, where, here and in the sequel, 

:= {x E n I d{x) < 5}. (7) 

We consider the fully nonlinear elliptic operator ([T]), with A C M™- closed and 

b : Q X A ^ M"", o : n X A — )• M„xn 

bounded and continuous, M„xn being the space of n x n real matrices. We further assume 
that a{x, a) is symmetric and nonnegative definite for all x, a. This implies that o = cjcj^ for 
some (T : n X A —)• M^xrj r > 1. Notice that we could take a E M„xn and symmetric, but 
we use this notation since in the following, for application to stochastic control problems, the 
matrix a will be obtained from a non symmetric a. 

In the interior of the diffusion is assumed to be non-degenerate. For some results, this 
will be required in the weak sense that the Strong Maximum Principle holds: 
if M E USC{Q) is a viscosity subsolution to T[u] = 0 in hi and there exists xq E hi such that 
u(xo) = max^u, then u is constant. 

For a detailed analysis of this property for the HJB operator F see [5]. It is satisfied if for 
any x E hi there exists ax & A such that the corresponding linear operator —iT{a{x,ax)D‘^u) 
satisfies Hormander hypoellipticity condition. In particular, it holds if a{x^ax) > 0 in the 
sense of matrices. 

The main regularity assumptions on the coefficients with respect to x will be the following. 
There exists a modulus of continuity co such that 

'^x,y£Q,a£A, \b{x,a) - b{y,a)\ < uj{\x - y\). (8) 

A modulus of continuity a; is a nonnegative function, continuous at 0 with a:(0) = 0. Moreover, 
we assume that the square root a of the matrix a is Holder or Lipschitz continuous uniformly 
in a, with sufficiently large Holder exponent, i.e. 

3/3 E (1/2,1] , H > 0, \/x,y&Q,a&A, \a{x,a) — a{y,a)\ < B\x — y\^, (9) 

where, even for matrices, | • | stands for the standard Euclidean norm. 

Remark 1. Note that we are not assuming Lipschitz continuity of the coefficients of the 
operator F, but just uniform continuity of the drift and Holder continuity of the matrix a, 
which in particular assure that the operator F is continuous. We will strengthen these as¬ 
sumptions to Holder continuity in Section 6 and to Lipschitz continuity in applications to 
stochastic control problems. 

The regularity assumption Q is given directly on the matrix a as it is natural for appli¬ 
cations to stochastic control problems. In any case, we recall some sufficient conditions that 
can be imposed on the matrix a in order to get that ([91) holds on the symmetric square root a. 
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Assume that a{-,a) E W‘^’P{Q,) for every a G A with p > 1 and that ||a(-, a)||vi/ 2 .p < C for C 
independent of a E A. Then it is proved in [291 Thml] that o'(-,a) E and moreover 

it can be observed that the norm of a is independent of a. Using Morrey’s inequality 

we have that if p = oo, then Q is satisfied with /3 = 1, and if p > 2n, then Q is satisfied 
with 13 = 1-^. 

We will make different kind of assumptions about the behavior of F at clfl. The first and 
weaker one is the following. 


3(5, A: > 0, 7 < 2/3 — 1, such that, for all x E dQ, there is a E A for which 

( a^{x,a)Dd{x) = 0, (10) 

|Vx E n n Bs{x), b{x,a) ■ Dd{x) + ii {a{x, a)D‘^d{x)) > kd'^{x), 

where /3 is the exponent in (l9|). The first condition in (11011 means that at any boundary point, 
the normal is a direction of degeneracy for T, at least for some a. The second condition is 
ensured if at the boundary the normal component of the drift points inward and is sufficiently 
large. We will see that fjlOl] ensures the existence of an appropriate Lyapunov function for the 
system, playing the same role as the already mentioned condition in m- Notice however that 
condition m does not prevent the function 6 (-, a) ■ Dd{-) + tr(a(-, a)D‘^d{-)) from vanishing 
at X, even though, in such case, it cannot be Lipschitz continuous because 7 < 1. 

Remark 2. A sufficient condition for (jlOp to hold (with 7 = 0) is the following: there exists 
A: > 0 such that for all x E dO. there is a E A such that the first condition in (llUp holds and 

6 (x, a) • Ild(x) + tr(o(x, a)i3^(i(x)) > k. ( 11 ) 

Indeed, from CID, using the hypotheses ([ 8 ]), ([9]) together with the regularity of d in a 
neighborhood of the compact set dO., we deduce the existence of (5 > 0 independent of x 
such that the second condition in (fTOll holds with 7 = 0 and k replaced by k/2. Notice that 
this argument does not work with k = 0, even though cAl is compact, because of the first 
condition in m- We exhibit a counter-example in Remark S] below, where we do not know 
if the Liouville property holds. 


Our first main theorem is the following result on nonexistence of nonconstant subsolutions. 


Theorem 2.1. Let ([HP- dTop hold and let F satisfy the Strong Maximum Principle in Ll. If 
u E USC{Ll) is a viscosity subsolution to F[u] = 0 satisfying 


lim sup 

x^dfl 


u(x) 

— log d(x) 


< 0 , 


( 12 ) 


then u is constant. 


Remark 3. Observe that Theorem l2.1l does not hold without imposing some growth condition 
at the boundary. Indeed one can check that, in = (—1,1), if a{x) > d^{x) for some £ > 0 
and d{x) small enough, then the function 


u 





is a subsolution to F[u] = 0 in for 6 small enough. Setting u{x) = n(l — S) outside n\n 5 , 
one gets a subsolution to F[u\ = 0. 


5 





On the other hand, we point out that the growth condition (I12p in Theorem 12 .1 1 can be 
weakened to the following: there exists k > 0 such that 

limsupn(x)d(x)'^ < 0. 

For more details we refer to Remark [71 We decided to work with the more restrictive growth 
condition ()12p because this provides us with a more detailed information on the boundary 
behavior of the solution of the ergodic problem, c.f. Theorem 12.21 

The analogous result for supersolutions to T[tt] = 0 can be obtained under stronger 
assumptions. In particular we have to strengthen condition ()10ll to hold for every a ^ A, m. 
the following sense. 

35, /c > 0, 7 < 2/3 — 1, such that, for all x G dO- and for all a G A, 
f cr^(x, a)Ddix) = 0, (13) 

G n, 5 , b{x,a) ■ Dd{x) + ti{a{x,a)D'^d{x)) > kd'^{x), 

Moreover, we assume that the operator F[u\ satisfies the Strong Minimum Principle, that is, 
the operator —F[—u] satisfies the Strong Maximum Principle. This property for our HJB 
operator F was studied in [6]. A sufficient condition for it to hold true is that 

a(x, a) > 0 for every x G and a G A. (14) 

Next, we use the results on nonexistence of nontrivial solutions to derive the unique 
solvability of the ergodic problem Q under the boundary condition ([2|). We strengthen the 
continuity assumption on the drift b of the operator ([1]) and require the same hypothesis on 
the source term 1: 


37 G (0,1], yx,yeQ,a£A, \b{x,a) - b{y,a)\,\l{x,a) - l{y,a)\ < B\x - . (15) 


Theorem 2.2. Under the assumptions ([9]), (|13p - (ll5p . there exists a unique c G M such that 
the equation (© admits a viscosity solution x satisfying 


X{x) 


lim 

x^dQ — log d[Xj 


= 0 . 


(16) 


Moreover x £ (3^(11) and is unique up to addition of constants among all solutions to (|3]l 
which satisfy (unp. 

Actually we prove a stronger uniqueness result for c and x, see Proposition 16.31 


3 Lyapunov functions 

3.1 The case of smooth boundary 

Proposition 3.1. Under assumptions ([9|) and cni), for every M > 0, there exists 5 > 0 such 
that 

F[—log((i(x))] > M, X G Xls, 

where Cls is defined in m- 
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Proof. Take <5, /c, 7 from m- Up to reducing S if needed, we can suppose that d E C‘^{ids). 
In particular, for given x E we can consider its unique projection on i.e., the point 
X E dQ satisfying \x — x\ = d{x) < 6. Let a be such that (fTOjl is verified. The first condition 
in (fTUj) and property Q yield 

\a'^{x,a)Dd{x)\ = |(T^(x, a)T>d(x)| < \a{x,a) — a(x,a)\ < Bd^{x). 

Therefore we get 

F[-log(i(x)] = sup fb(x,a) • + ti fa{x,a) ^ ^ \a'^{x,a)Dd{x)\'^'\ 

a£A \ Cii^X) \ (iyX) J (1 \X) J 

> (b(x,a) ■ Ddix) + tr(o(x, - A o'^ix,oi)Ddix)\^ 

d[x) d^[x) 

> k(p-\x) - B'^d'^l^-^ix). 

Since 7 — 1 < 2/3 — 2, we can further reduce 5, independently of x, in such a way that 
kdP~^ — B‘^d?^~‘^ > M in U 5 , concluding the proof of the proposition. □ 

If we replace (11011 with (1131) . then the following stronger version of Proposition 13.11 holds. 

Proposition 3.2. Let dH) and (USD hold. Then for every M >0 there exists (5 > 0 sueh that 

F[log(i(x)] < —M, X E U 5 . (17) 

Proof. By explicit computation, 

F[log<i(x)| = - inf (kf n) ■ ^ + tr (n(n, o)'^) - ■ 

The conclusion then follows from a straightforward adaptation of the argument in the proof 
of Proposition 13.11 □ 

We conclude this section with two comments about the optimality of condition (1101) for 
the construction of the Lyapunov function. 

Remark 4. The function — log d{x) might not be a Lyapunov function if (1101) is relaxed to 
the following: for all x E dLl there is a E for which 

A{x,a)Dd{x) = 0, b{x,a) ■ Ddix) + tr(a(x, a)Zl^d(x)) > 0. (18) 

Let us show this with an example. Let U be a domain in coinciding, in a neighborhood of 
(0,0) E dPl, with the half-plane {(x,y), x E M, // > 0}. Take A = {1,2}, 

fe(a;, 2 /,l) = ( 0 , 1 ), o-(x,y, 1 ) = ^J 

Kx,yA = - y), cr(x,y, 2) = ^ Q ^ 

and a = aA. Note that in a neighborhood of (0,0), d{x,y) = y, whence Dd{x,y) = (0,1) 
and D‘^d{x,y) = 0. One can readily check that (fTHI) holds at the points (x,0), with a = 1 if 
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X = 0 and a = 2 otherwise, whereas the second condition in (|10l) is not verified at x = (0,0) 
by neither a = 1 nor a = 2. Let ns check that — \ogd{x) is not a snpersolution of F = 0 in a 
neighborhood of (0,0). For {x,y) G O close to (0,0), we have that 


F[-\ogd{x)] = 


Dd{x) ( D^d{x) 
max I b(x, a) ■ ——h tr a{x,a) ——— 
aG{o,i} V d{x) \ d[x) 


d?‘{x] 


|cr'^(x, a)Dd{x)\‘ 


= max <- 

y 


1 (x^ + y)'^ x"^ 


- 2 


Now, if y = x^, then 

4 

—-2 = -l< 0 , 

y 


1 _ (x^ + ?/)^ _ 1 _ iy/y + y)'^ 

y y2 y y2 


This shows that F[—logd(x)] < 0 at some points arbitrarily close to (0,0). 

Remark 5. Note that 7 in (|10p satisfies 7 < 1, because /3 < 1. If we allow 7 = 1 , then 
we are only able to obtain a “weak” Lyapunov function, that is a strict snpersolution to the 
equation in a neighborhood of the boundary, but not exploding at the boundary. Indeed if 
we assume that the second condition in m holds with 7 = 1 , then for every 7 > 0 , there 
exists (5 > 0 such that 

F[- log{d{x) + 7 )] > 0, X G Qs- 

This follows from the same arguments as in the proof of Proposition 13.11 the final step being 
now the choice of J > 0 such that 


Vx G 


kdjx) _ ^2 d'^^jx) 

d{x) + 7 {d{x) + 7 )^ 


3.2 Case of non-smooth boundary 

When the domain Q. is not assumed to be C^, a partial result in the direction of ProDosition l3.ll 
is obtained under the following assumption: for all x G dll, there exist a G d, a neighborhood 
U oix and a constant k > 0 such that 

— b{x, a) ■ Dd{x) — ti a{x,a)D‘^d{x) <—k, x G II n t/ (19) 

in viscosity sense, and 

Vz G dn n t/, \lv^N{z), {z,Oi)v = Q, (20) 

where N{z) is the interior normal cone to H at z, or, equivalently, the set of generalized 
exterior normals to as defined in [H p. 48]. Namely, a unit vector v belongs to N(z), 
z G dn, if there exists x G H such that x = z + d{x)i>. Due to the possible lack of regularity 
of d, condition (I19p has to be understood in the following sense: 

Vx G D n t/, \/{p,Y) £ j‘^'~^d{x), —b{x,a)-p — ti:a{x,a)Y<—k, (21) 


where 

j'^’~^d{x) 


(p,y) gm^x s. 


lim sup 


d{y) - d{x) 


p-jy-x)- k[y-x)Y ■ {y 

\y — 
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If the boundary is smooth, (11911 is equivalent to (11111 whereas (|20p is slightly stronger than 
the first condition in (llUp . so, combined, they imply condition (IIUII (see Remark [2]). 

The normal cone N(z) and the set of projections 

P{x) := {z & dQ : \x — z\ = d(x)} 

allow us to give the following representation. 

Lemma 3.3. For x £ Q, let {p,Y) G j'^’~^d{x). Then p = limj pj where for all j there exist 
Ai > 0, i = 1,..., N , Ai = 1, and Zi G P{x) such that 

N 

Pj = '^Xini, Vi£N{zi). 

i=l 

Proof. The condition {p, Y) G J‘^'~^d{x) yields 

d{y) - d{x) -q-{y-x) ^ 

\y-x\ ~ j 

Proposition II.2.14 in [3] states that the set D'^d{x) coincides with the closure of the convex 
hull of the set 

On the other hand, z G P{x) implies x = z + and therefore |f5fi £ N{z)- □ 

Proposition 3.4. Let ([8]), ([9]), (fTHp . (I20ll hold. Then, for any M > 0, there exists <5 > 0 
such that — log((i(x)) satisfies in viscosity sense 

F[—log{d{x)] > M, x£ dis¬ 
proof. Note that ([5]), ([2]) assure that the operator T[u] is continuous. For a fixed x £ ddl 
take a £ A and the neighborhood U such that dm) and (f2nil hold. For x G 11 0 17 consider 
{p, Y) £ J^’+d(x). Take pj —>• p as in Lemma [331 The orthogonality condition ([2Up yields 

N N 

a^{x,a)pj = Xiu'^{x,a)ui = Xi{a'^{x,a) - {zi,a))ui. 
i=l i=l 


p £ D^d{x) := < (? G 


lim sup 


Then, by ([31), 

N 

\cr'" {x,'a)pj\ < ^ XiB\x — Zi\^ = Bd^{x), 

i=l 


from which, letting j —)• oo, 

\a'^{x,a)p\ < Bd^{x). 


Now we want to prove that F[—logd(x)] > 0 in viscosity sense. Note that if {q,Z) £ 
log d{x)) then there exist {p, Y) £ J‘^'~^d{x) such that q = —^^and Z = 
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Using ([2T|) we derive 


( p Y 1 \ 

b{x,a) ■ +tTa{x,a)-^ - --^^\a'^{x,a)p\‘^ 

d[x) d{x) d^[x) ) 

- ~Jr\ iKx,a) ■ p + tr{a{x,a)Y) - {x,a)p\‘^ 

d[x) d^[x) 

So, for given M > 0, 6 > 0 can be chosen sufficiently small, depending on x (because k does) 
but independent of x,p,Y, in such a way that 

F[— log d{x)] > M, X G n [/ 

in viscosity sense. This means that there is a neighborhood W of 50 such that 

F[-logd(x)] > M, xGQnW, 

and thus the conclusion of the proposition holds for some (5 > 0 by the compactness of 50. □ 

Remark 6 . If we assume in Proposition 13.41 that conditions (I19|) and (1201) hold for every 
a G A, then we obtain that for any M > 0, there exists 5 > 0 such that — log(d(x)) satisfies 
in viscosity sense 

inf (—b(x,a)-D(—logd(x)) — tr{a(x,a)D^(—logd(x)))) > M, x G 

aGA 

4 Nonexistence of nonconstant solutions 

Using the Lyapunov functions constructed in the previous section we now prove that F[u] = 0 
has only trivial sub and supersolutions. 

Proof of Teorem \2.1[ Let 5 be from Proposition 13.11 corresponding to M = 0. We can assume 
without loss of generality that <5 < 1. Define Qs as in ([7]) and 

Ks := max u. 

For e > 0 the function u{x) — {Ks — elogd{x)) is negative when d{x) = 6 and, by (fTTIl . it 
goes to —oo as X —)• 5D. Suppose by contradiction that it is positive somewhere in Then 
there exists xq G D 5 such that 

tt(xo) — {Ks — elogd(xo)) = max[tt(x) — {Ks — elog(i(x))]. 

Since tt is a subsolution to F[u] = 0, this implies that 

eF[-logd(xo)] < 0 , 

which is impossible by Proposition 13.11 We have therefore shown that 

Vx G D 5 , u{x) < Ks — £logd{x), 

whence, letting e —>■ 0, u < Ks in This means that u achieves its maximum Ks inside D 
and then it is constant since F satishes the Strong Maximum Principle in D. □ 
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In the case of nonsmooth boundary, the same result holds true, under stronger regularity 
assumptions on the coefficients. 

Proposition 4.1. Instead of dll of class assume that anyx E dH has a a neighborhood U 
such that (USD and (ESD hold for some a ^ A and k > Q. Suppose also that b,a are Lipschitz 
continuous, i.e., the continuity modulus in ([SD is uj{r) = Br for some B > 0 and /3 = 1 
in (jSD, and F satisfies the Strong Maximum Principle in II. If u G USC{Il) is a viscosity 
subsolution to F[u] = 0 satisfying (fT^ then u is constant. 

Proof. We use the same notation as in Theorem 12.II Now, owing to ProDosition l3.4l 0 < 5 < 1 
is chosen in such a way that — logd(x) satisfies in viscosity sense F[—log(i(x)] > 1 in Qs- 
Using the doubling variables method we define, for r/ > 0 and x,y G 


^(x, y) := u{x) - Ks+s log d{y) - 


\x - y'f 
2r] 


Observe that, due to sup(o^)2 $ < +00. Take {xn,yn) small such that ^{xn,yrf) = 

I 12 

supf^2 d*. By ISH Lemma 3.1], -)• 0 as ry —>■ 0, and up to subsequences, y^^ ^ x G Us 

such that n(x) — Ks + £ log d{x) = sup^^ u — Ks + £ log d. 

If ^{xn,yr]) < 0 then 4>(x,x) < 0 for x E 0^, from which, arguing as in the proof of 
Theorem EU we infer that u achieves a maximum in 11 and then it is constant. 

Suppose then that ^{xrj,yrj) > 0 for all ry > 0. By classical argument (see [211 Theorem 
3.2]), we get that there exist X,Y G Sn such that G J^’+u(xr^), , Y ^ E 

{-£\ogd{yn)) and 


pX ■ p — qY ■ q < -\p — q\^ y p,q G 
rj 


( 22 ) 


Let ei, for i the i-th unit vector. Then it is easy to check for every a G A, 

tr a(Xf/, a)X = J2i=i(^(xr/, Oi)ei)X ■ (a(x,j, a)ei). So, by (|22D applied to p = a{xr],a)ei,q = 
o'{yrj, a)ei, we get that for every a E 

1 ^ ” lx ?/ P 

tra(x^,a)X - tra(y^,a)F < - ^ ^ |crp(x^, a) - aji{yr,,a)f < B‘^'-A1 - H— 


rj 


i=l j=l 


ry 


where we used the fact that a is Lischitz continuous. Using the fact that b is Lipschitz 
continuous we get 


- l/r?!' 


I^(y7?,a) - b{xrj,a )\'^-^—^ < B 


Using the previous inequalities and the fact that u is a subsolution to T[u] = 0, we get 


0 > e sup ( —6(x„, a) • —— — tr a(xrj,a)X] 

aeA\ V ) 

> £sup (-b{yr,, a) ■ ^^ - tr(a(y^, a)y) 

aeyl V S 


_ _ ^^2 (\xv - yy\^ 


r] 


ry 


which gives, for ry sufficiently small, a contradiction to the fact that T[—log(i(x)] > 1 in 
viscosity sense in 11,5. D 
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If we strengthen condition (jlOl) to condition m, and let F[u\ satisfies the Strong Min¬ 
imum Principle in that is —F[—u\ satisfies the Strong Maximum Principle in we also 
obtain the statement for supersolutions. 


Theorem 4.2. Let conditions (0), m, d hold and let F satisfies the Strong Minimum 
Principle in If v G LSC{Ll) is a viscosity supersolution to F[u] = 0 satisfying 


liminf — ^ > 0, 
x-s-an — log d[x) 


(23) 


then V is constant. 


Proof. Note that u is a subsolution to —F[—u\ = 0. So, we conclude, using the same arguments 
as in the proof of Theorem 12.11 by substituting Proposition 13.II with Proposition 13.21 □ 

Remark 7. Theorems 12.11 and 14.21 can be improved by replacing the growth conditions p2l) 
and (|23|) with, respectively. 


limsup M(x)d(x)'^ < 0, and 
x^dQ 


liminf u(x)d(x)'' > 0 


for some k > 0. 

Indeed, observe that for every M > 0 and every k > 0, there exists <5 > 0 such that 


F[d{x) 


d{x) 


aeA 


sup ( b{x, a) ■ 


Dd{x) 

d{x) 


+ tr ( o(x, a) 


D‘^d{x) 


d{x) 


K “t“ 1 I rp 


d?{x) 


(x, a)Dd{x)y 


> kndfi-^-'^ix) - + l)d^^-^-^{x) > M 


for every x G by assumption m- Analogoulsy we get that for every M > 0 and every 
K > 0 there exists d > 0 such that F[—d{x)~'^] < —M for every x G 

So, the same arguments of the proofs of Theorems 12.11 and 14.21 can be repeated by simply 
substituting d{x)~'^ to — log(d(x)). 

We state the analogous of Theorem 12.11 in the case of nonsmooth boundary. 

Proposition 4.3. Instead of dCl of class assume that anyx G dPl has a a neighborhood U 
such that d and d hold for every a G A and k > 0. Suppose also that b,a are Lipschitz 
continuous, i.e., the continuity modulus in (0) is uj{r) = Br for some B > 0 and /3 = 1 
in (0), and F satisfies the Strong Minimum Principle in Pi. If v G LSC{Pl) is a viscosity 
supersolution to T[u] = 0 satisfying ipS]) then v is constant. 

Proof. Observe that — x is a viscosity subsolution to 

in^ (—6(x, a) ■ Du — tr (a(x, a)D‘^u)) = 0 

and satisfies (USD. Moreover by assumption, the operator 

G[u] = in^ (^—b{x, a) ■ Du — tr (a(x, 

satishes the Strong Maximum Principle. So, recalling Remark [6l we can repeat the proof of 
Proposition I4.1l bv substituting the operator T[ti] with the operator G[u\. □ 
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5 An application to stochastic control problems with exit times 

We consider the control system ([2]), where Wt is a r—dimensional standard Brownian motion 
and the control a. : M+ —)• A belongs to the set of admissible controls A, namely, progressively 
measurable processes, with respect to the filtration associated to the Brownian motion. 

In order to have existence and uniqueness of solutions to the control system, throughout 
this section we will strenghten the regularity assumptions on the coefficients to the following. 
We assume there exists B > 0 for which 

Vx, 2 / G a G A, |6(x, a) — b{y, a)| < B\x — y\, \(y{x, a) — a{y, a)| < B\x — y\. (24) 

Moreover, to ensure existence of optimal controls for the optimal control problems we are 
going to consider, we assume that the set A is compact and 

{( 6 (x, a), a(x, a)) \ a ^ A} is convex for all x G fl. (25) 

Define for every x G D the exit time from the open set D 

r"- = inf{t > 0 I W"' 0 D} G M U {+oo}. (26) 

It has been proved in [ 8 ] that under the previous assumptions, the set O is viable or weakly 
invariant for the control system ([2|) in the following sense: for every x G D there exists an 
admissible control a. such that G D almost surely for all t > 0. In the next proposition 
we prove that actually in our case this result can be improved to get also the viability of the 
open set D. Such a result was obtained in m for stochastic systems without control. 

Proposition 5.1. Let (uni), m, (ESI) hold. Then for every x G D there exists an admissible 
control a. G A such that Xf' G D almost surely for all t >0, i.e. r“' = +oo almost surely. 

Proof. Let V he a. extension of the function — log((i(x)) to the whole Q, which coincides 
with — log(i(x) in a neighborhood of dLl. We can assume that P > 1 in D and moreover, by 
Proposition 13.11 there exists a constant C > 0 such that 

F[V]{x)>-C xGD. 

Define for every 5 > 0, and x G D, the exit time 

rj’"' = inf{t > 0 I 0 D \ G M U {+oo}. 

By superoptimality principles for viscosity solutions (see m Corollary 6 ]), we get for 
every J > 0, every x G D \ and every t > 0, recalling that V > 1, 


V(x) > inf E 
a.eA 


V{X% 

Tx 


where ri’”' At = min{ri’, t}. Take 6 
dsn we get that for every t > 0 

inf P (ui I 
a.eA V 


> inf 

[ V{X%,{u))dF{u)-Ct 

a.eA 

J iA<t} 


(27) 


> 0 such that V(x) = — log d{x) for x G \ dLl. From 


Tp iul) < t) 


V{x) + Ct 
-log (5 
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Moreover, since info,. P | Ti’“ (a;) < is decreasing as <5 ^ 0, we get that, for all x G fl, 

inf inf Pfw 1 < t) = 0. 

(5 a.£A V / 


So, for every t > 0, 


inf P(u;|r“ (a;)<2) = 0. 
a.eA 

(28) 

Finally we claim that (|28p implies that 


inf P(a; | r"'(a;) < +oo) = 0. 
a.GA 

(29) 


Let hhe a bounded uniformly continuous function such that /i = 0 in n and /i > 0 in R” \ n. 
Let 

/*+oo 


r+oo 

w{x) = inf E / h{X^ ) 
a.dA Jq 


(30) 


So 0 < tc < 1!—ILs., Moreover, by standard dynamic programming principle (see [25]) for every 
t > 0 "" ^ 

w{x) = inf^E h{Xf )e-‘'^ds^ . 

Fix e > 0 and take t such that < e. So, for every x € due to 


w{x) < inf E / h{Xg )e '^^ds + e<£, 
a.eA Jq 

from which we deduce by arbitrariness of e, rc = 0. This implies (1291) . recalling that under 
assumption ()25p . for every initial data x G 12 there exists an optimal control for the control 
problem pUjl (see |2S]). □ 

Consider a terminal cost (p G (7(512) that the controller pays as the system hits the 
boundary. We introduce the cost functional 


(7(x, a, oj) = 

and define the value function 


PiX^^. (uj)) r“'(a;)<+oo 

0 t“' (w) = +00, 


v{x) = inf E [G{x,a.,uj)]. 
o.eT 

We make a non degeneracy assumption on the system at a minimal point for p which is 
somehow opposite to condition (fT0|) . 

{ 3 X G 512, A such that p{x) = minp and 
either (T'^{x,a)Dd{x) ^ 0,or b{x,a) ■ Dd{x) + ti{a{x, a)D‘^d{x)) < 0. 

Theorem 5.2. Let (HOD, ([MD, (ESj) and (laD hold. Then the value function v satisfies 

Vx G 12, v{x) = min{min(^, 0}. 
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Proof. The value function v is known to satisfy a dynamic programming principle (see |25ji. 
From this it is possible to deduce (see [TUI Thm 4.4], [TU] i that the upper semicontinuous 
envelope of v, defined as 

v*{x) := limsup v{y), x G Q, 

is a viscosity subsolution of the HJB equation F[u] = 0 in and satisfies the Dirichlet 
boundary condition u < (f) on d^l in viscosity sense (that we will recall later). Then, by 
Theorem 12.11 v* is constant in Q, say u* = c in fl. 

By Proposition 15.11 for every x G 11 there exists an admissible control a. such that G Pt 
almost surely for all t >0. So, if mine/) > 0, then it is immediate to deduce by the definition 
of V that u = 0 in n. 

We assume now that vninf) < 0, and we show that in this case v = vninf) on H. Being 
upper semicontinuous, v* satisfies v*{x) > c for x G 911. Since v* > v > vninf =: m, we 
must prove that m> c. Assumption m allows us to build an upper barrier at the point x, 
namely, a function W G C'^{B(x,r)), with r > 0, such that: 

i) VF > 0 and LW > 0 in B{x, r) n H, 

ii) W(x) = 0, W(x) > /i > 0 for all X G n with |x — x| = r. 

For k,X > 0 set 

y[r(^x) := 1 — 

It is easy to compute 

- tr(a(x, a)D^W{x)) - b{x, a) ■ DW{x)'j = 

— k tr(a(x, a)D‘^d{x)) + k‘^\a{x, a)Dd{x)\‘^ — kb{x, a) ■ Dd{x) — 2kX tr a(x, a). 

Next we choose a = a and assume first the first condition in (l.lip to hold. In this case, since 
the coefficients are continuous and d is close to 911, we can get F[W] > 0 in a neighborhood 
of X by taking k large enough. If, instead, the second condition in (13ip holds, we choose A 
small to reach the same conclusion. Properties ii) of the barrier are obvious. 

Assume by contradiction that m < c and fix m' G (m, c) and r' > 0 such that 

Vx G B(x, r') n 911, (/)(x) <m'<c. 

Now call p := min(r, r') and define, for A: > 0, 

w{x) := kW{x) + m. 

Observe that F[w] > 0 in B{x,p) H 11 by the homogeneity of the operator F. Choose also k 
large enough so that 

Vx G H, |x — x| = p, w{x) > M. 

Next take xq G B(x, p) O 11 such that 

{v* — w){xq) = max (v* — w). 


There are three possible cases. 

1. If xo G dB{x,p) n H then w{xo) > M > v*{xo). It follows that v*{x) < w{x) for x G 
B{x,p) n 11, which, taking x in a neighborhood of x, yields the contradiction c < w{x) < m'. 
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2. If xq G B{x,p) n 12 we use that v* is a subsolution of F[u] = 0 to get F[t(;](xo) < 0, a 
contradiction with F[w] > 0. 

3. Finally, if xq G B{x,p) H d^l, we use that v* is a viscosity subsolution of the boundary 
condition, namely, either u*(xo) < </>(xo) or F[t(;](xo) < 0. The latter case is impossible 
because F[w] > 0, whereas the former contradicts (p{x) < c < v*{x) in B{x,p) H dCl. 

In all cases we reach a contradiction and complete the proof. □ 

Remark 8. The conclusion of the last theorem still holds if the regularity of 512 holds 
only in a neighborhood of x, provided that m is replaced by (USD and ([20D • In fact the 
Liouville property still holds by Proposition 14.11 

6 The ergodic HJB equation in invariant bounded domains 

In this Section we will assume the stronger condition (|13l) on the behavior of the coefficients at 
the boundary of the domain 0, as well as the strict ellipticity of the operator L in the interior 
of 12 (|14D . We will see in Section 16.21 that the assumption (113^ is related to the invariance of 
both 12 and 12 for the control system (jsp. 

6.1 Well-posedness of the PDE 

This subsection is dedicated to the proof of Theorem 12.21 We set 

H{x,p, X) := sup {—b{x, a) ■ p — tr(a(x, a)X) — l{x, a)) , (32) 

aeA 

where / : 12 x d —>■ M is a bounded function satisfying (fT^ . In order to find a solution to ([3D , 
we consider the approximated problems 

Xu\{x) + H{x, Du\{x), D‘^ux{x))) = 0, x G 12, (33) 

for A > 0. We start with showing that this equation admits a unique viscosity solution, 
without prescribing any boundary conditions. 

We recall the following well-known a priori estimates. 

Lemma 6.1 (Krylov-Safonov estimates). Let Assumptions ([OD, ()14p and ()15l) hold and let 
u G (7(12) he a bounded viscosity solution to (I55D with A > 0. Then u G (7^(12), and for every 
compact set K C Ll there exists 7 G (0,1), depending on the space dimension n, the ellipticity 
constants in K and /3 from (0 such that 

ll'*^llci’T'(i^) < Ck, 

with Ck depending on 7, K, 12, ||o'||ooj B from ([SD? Halloo; Halloo? Halloo and any A > A. 

Proof. For the proof we refer to [32] , Theorem 2.1 and section on further regularity, pag. 950. 
See also [31], [211 Sec. 17.4]. □ 

Theorem 6.2. Under the assumptions dlD, (fT3]l - (fT5]l . for every A > 0, equation (l33l) admits 
a unique bounded solution u\ G C^(I2). Moreover for every x G 12 and every K CC 12, the 
family {ux — ifA(5))Ae(o,i] *■5 bounded in for some 7 G (0,1). Finally, for all h > 0, 

there exists (5^ > 0 such that 

VA G (0,1], X G 125,^, hlog{d{x)) + min ux < ux{x) < —/ilog(d(x)) -|- max ux- (34) 
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Proof. The proof is divided into three parts. 

Step 1. Existence. 

The idea is to apply Perron’s method to the Neumann problem for (1331) . namely, under the 
boundary condition dyU = 0. Notice that the functions ±||Z||oo/A are sub and supersolutions 
for such problem. However, a technical difficulty in the comparison principle comes from 
the lack of Lipschitz-continuity of the terms a, b. Also, the application of Perron’s method 
to this problem is achieved in [9] under the additional assumption that Q is of class 
To overcome these difficulties one can proceed as follows. Consider a sequence of smooth 
approximations of the o(-,a), b{-,a) and a sequence of smooth domains invading O. The 
associated Neumann problems admit solution between —||Z||oo/A and ||/||oo/A by [9]. Finally, 
using the estimates provided by Lemma l6.II and the stability of viscosity solutions, one can 
pass to the limit along a subsequence of such solutions and obtain a solution ux to (|33]) . Notice 
that the limit is only local in n and therefore we lose the information about the boundary 
behavior of ux. We only know that ux is in (7^(0) and satisfies 

VxeO, _Mk <^^(^) < Mel. (35 ) 

A A 

Step 2. Uniqueness. 

Consider two bounded viscosity solutions u,v £ C'(n) to ([331) . Then they are both in C'^{Q) by 
Lemma [6.11 We first modify v in order to obtain a supersolution blowing up at the boundary. 
To this end, we will make use of the Lyapunov function — log(fi(x)) for the operator F defined 
by (P). Take 5 > 0 from Proposition 13.21 associated with M = 0, and consider the function 
— log((i(x)) defined for x E Qs- Let V he a. extension of this function to the whole Ul. Up 
to replacing 6 with min(5,1), we have that U > 0 in Qs- Then, for e > 0, define 

Vs ■= V + + e. 

Using the fact that v satisfies (I55|l . we find that, for x E 12, 

\vs{x) + H{x, Dvs{x), D‘^Vs{x)) > Xe'^V (x) + Ae 

+ inf (b{x, a) ■ DV (x) + tr(a(x, a)D‘^Vix))) 

aeA ^ ' 

= e^{\V{x) - F[-U](x)) + eA. 

This last expression is positive if x E because F[—V] < 0 there. Otherwise, if x E 12\125, 
it is larger than e(A — Ce), where C is a constant only depending on re, A and the L°° norms 
of a,b,V, DV, D^V in 12 \ 12^. We deduce that Vs is a supersolution to (l33]l provided e is 
smaller than some eo. Now, since {vs — u){x) -A- +oo as x ^ 912, the function Vs — u 
attains its minimum on 12 at some point y. By regularity we have that Dvs{y) = Du{y) and 
D‘^Vs{y) > D‘^u{y). Therefore, if e E (0,eo), we obtain 

0 < Xvs{y) + sup {-b{y, a) ■ Dvs{y) - tr(a(y, a)D^Vs{y)) - l{y, a)) 

aSA 

< \{vs - u){y) + Are(y) + sup {-b{y, a) • Du{y) - tr(o(?/, a)D‘^u{y)) - l{y, a)) 

a£A 

= \{vs - u){y). 

It follows that Ue > re in 12 and thus re > re in 12 by the arbitrariness of e E (0, eo)- Reversing 
the roles of re, re we eventually derive re = re. 
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Step 3. A priori bounds. 

We start with deriving (|34|) . Fix h > 0 and let 6h be the <5 given by Proposition 13.11 with 
M = 2\\l\\^/h. Set 

V{x) := —hlog{d{x)) + max ux. 

It is not restrictive to assume that Sh < 1, so that V{x) > u\{x) if d{x) = dh- On the other 
hand, there exists 6' E (0, small enough, depending on A, such that V{x) > ||Z||cxd/A > 
ux{x) if d{x) < 5' . Finally, since ux > —||Z||oo/A and F\y] > hM = 2||Z||oo, for x E we get 

AF(x)+sup [—b{x,a) ■ DV{x) — tT{a{x,a)D‘^V{x)) — l{x,a)) > A max riA+-P[P] — ||^||oo > 0. 
aeA 

It follows from the fact that ux is a (sub) solution to p3]l that 

VS E (0,(5'), ma x (ux — V) = ma x (ux — V) < 0. 

Namely, ux <V m. which is the second inequality in The first inequality is obtained 
in analogous way, by using Proposition 13.21 in place of 13.11 and considering the subsolution 
V{x) := ux + hlog{d{x)). 

We now fix X E O and we claim that the functions (ua)ag(o,i] defined by 

vx{x) := ux{x) - ux{x) 


are equibounded in any K CC hi. Assume by way of contradiction that there exists K CC hi 
such that 

^A^ •= IIw||l°°(x) +00 as A —)• O'*". 

Up to enlarging K if needed, we can suppose that x G K and that, for (5i from ([5^ . hl\hl5^ C 
K. The function ipxix) '■= sxvx{x) satisfies ||V^A||L°“(_ft') = Ij V’a(S) = 0 and 

Xtjjx + Xexux{x) + sup [—b{x, a) ■ Dipxix) — tr(a(x, a)D'^'tjjx{x)) — exl{x, o:)) =0, x E hi. 
a&A 


Note that |AeArfA(5^)| < EaIKIIoo —>• 0 as A ^ 0. Furthermore, by for x E Q\K, 


i^\{x) 


ux{x) - ua(x) ^ maxQ\Q^^ ux - log(d(x)) - ua(x) 
\\ux-Uxix)\\L^^K) ~ \\u\-Ux{x)\\l-°{K) 


<l-ex log((i(x)). 


and 


ipx{x) > 


ux + log{d{x)) - ux{x) 
I^A - Ux{x)\\l^{K) 


>-l + ex log(d(x)). 


A first consequence of these estimates is that, in any compact subset of hi, the tpx are equi¬ 
bounded, whence equibounded in by Lemma l6.ll Using a diagonal procedure, we can 
then find a sequence A —)• 0 for which the 'ipx converge locally uniformly in hi to some function 
’ll) E (^(hl). By stability property of viscosity solutions, ip solves 


sup (—6(x, a) ■ D'ip{x) — tr(a(x, a)D'^'ip{x))) =0, x E hi. 
aeA 


We further know that ||V'IIl°°(_r') = 1) and, for x E Q,\K, \)p{x)\ < 1 because |V'a(3;)| < 
1 — ffA log((i(x)). This means that ip attains either the global maximum 1 or minimum —1 
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in K, and therefore it is constantly equal to 1 or —1 by the Strong Maximum or Minimum 
Principle, which holds by (|14l) . This is impossible because = 0. 

We have shown that the v\ are equibounded in any K GG 0,. Since they satisfy (1331) with 
I replaced by I + Xux{x), and |AttA(x)| < ||/||oo) Lemma ISTTl eventually yields that they are 
equibounded in 

□ 


We are now in the position to prove our main result. 

Proof of Theorem \2.SX First of all we prove that there exists c G M such that (l3|) admits a 
solution. Consider the solutions (uA)Ag(o,i] to (I55|) . Fix x G fl. By (15^ . \u\{x) converges 
(up to subsequences) to some value — c as A —)• 0. Define v\ = u\ — u\{x). Theorem 16.21 gives 
that the vx are equibounded in for any K GG D. Thus, using a diagonalization 

procedure, we can extract a subsequence of vx converging locally uniformly to x G C'(D), 
which, by stability, is a viscosity solution to ([3]). We know from Lemma l6.II that x £ C'^(D). 
Moreover, x satisfies the same bounds (IMll as the ux (and the vx)- Using the fact that such 
bounds hold true for arbitrary /i > 0, we eventually find that x fulfils (|16p . Uniqueness of c 
and X (up to constants) follows by the following stronger uniqueness result. □ 

Proposition 6.3. Let xi and X2 be viseosity solutions of (I3|) with, respectively, c = ci and 
c = C 2 - Assume moreover there exist ac > 0 such that 

lim xi{x)d{xY = 0 = lim X 2 {x)d(xY. 
x^an x^an 

Then ci = C2 and there exists a constant k gM. such that xi = X2 + 

Proof. First of all, observe that by Lemma EH Xi)X 2 £ C^(D). Without loss of generality 
we can assume ci > C2. So, 

sup {-h{x, a) ■ D{xi - X2) - tr(a(x, a)D^{xi - X2))) > ci - C2 > 0 . ( 36 ) 

a&A 

By Theorem 14.21 and Remark [3 xi — X2 is a constant, and therefore ci = C2. □ 

Remark 9. If we weaken the Holder regularity (1151) on the coefficients b, I of equation (I33p 
to the uniform continuity as stated in ([8|), Krylov Safonov estimates stated in Lemma [6.II still 
hold, but we just expect that any bounded continuous viscosity solution to (f33p is (^^’"(H) 
for every a G (0,1), not in 

This implies that in Theorem 16.21 and in Theorem 12.21 the solutions ux to (I33p and X to © 
are of class C'^’"(H) for every a G (0,1). So, in the step Uniqueness of the proof of Theorem l6.2l 
the argument has to be modified by using the by now standard doubling variables argument 
in the theory of viscosity solutions (see e.g. [2T]). Moreover, also in the proof of Theorem 
the argument to prove that xi ~ X2 solves ([5SP has to be modified appropriately. 

6.2 A stochastic control interpretation 

We show an application of the previous results to an ergodic control problem in H with state 
constraints. Throughout this subsection, we will assume the stronger regularity assumptions 
on the coefficients (I24p to hold. It is known from [Hi that, under the assumption (|13p on 
the behavior of the coefficients near dfl, the set LI is invariant for the control system ([S|) in 


19 


the following sense: for every x G and any admissible control a. G A, the trajectory of ([5]) 
satisfies X^' G H almost surely for all t > 0. 

Therefore no restrictions on the controls are needed to keep the system forever in fl, and 
we can define the value function of the infinite horizon discounted control problem with state 
constraint 

xeTi (37) 

where f H x A ^ M is a bounded function satisfying ([5]) and A > 0. The next result states 
that vx is the solution of the PDE ([33]) . 

Proposition 6.4. Let (HSl) and (|24l) hold. Then vx is continuous in LI and it is a viscosity 
solution of (l33]l . 

If, in addition, m holds, then vx{x) = ux{x) for all x G Ll, where ux is the smooth 
solution of (f33]l given by Theorem Ah.A 

Proof. Fix e > 0 and T large enough so that e~^*l(Xf‘', at)dt < e for all x and a.. Pick 
x,y G Ll and a control a. G A e—optimal for the initial point y. Then, denoting with Yf^' the 
trajectory starting form y and using such control, 


vx{x) := inf E 
a.GA 


f 

Jo 


e-^H{X^-,at)dt 


vx(x) - vx(y) < E 



e-^*ll(X^^-,at)-l(Y°-,at)ldt 


+ 3e. 


Now we use the standard estimate E \\X^' — Yf^' |] < e^*|x — y\ and the assumption \1{X, a) — 
l{Y,a)\ < ijj\X — Y\, where the modulus u can be assumed to be concave w.l.o.g., to get 


vx{x)-vx{y)< [ e ^^oj{e^^\x-y\)dt + ^e 
Jo 

and the right hand side can be made smaller than 4e by choosing \x — y\ small enough. Then 
the continuity of vx is obtained by repeating the argument with the roles of x and y reversed. 
Once this is established the Dynamic Programming Principle is a standard result, as well as 
deducing from it that vx solves the equation in LI in viscosity sense, see, e.g., [23] . 

The last statement follows from Theorem 16.21 □ 


Next we show that under the conditions (fM|l and (fT3|l of this section also the open set Ll 
is invariant for the control system ([S]), in analogy with Proposition 15.11 

Proposition 6.5. Assume dH and ([2411 . Then, for every x G Ll and every admissible control 
a., X^' G Ll almost surely for all t > 0, i.e. r“' = +oo almost surely, where r“' is defined in 

(ESI). 


Proof. The proof follows the same arguments as in the proof of Proposition 15.11 Let U be 
a extension of the function log((i(x)) to the whole Ll, which coincides with logd(a:) in a 
neighborhood of dLl. We can assume that U < —1 in Ll and moreover, by Proposition 13.41 
there exists a constant C > 0 such that 


F[U]{x) < C 


x G Ll. 


By suboptimality principles for viscosity solutions (see [IS]), we get for every <5 > 0, every 
X G D \ and every t >0, recalling that V < —1, 


Uix)< inf E UiX% )+C{4’°- At) 
a.&A L Tx’ At 
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and then for all x E and all (5 > 0 


sup P (a; 
a.&A ^ 


< t) 


Ct — U (x) 
-log (5 


So, for every t > 0, 


sup P {ui I r"' (w) <t) = 0. 
a.eA 


From this we conclude as in the proof of Proposition 15.11 that P (w | t“' (ui) < +oo) = 0 for 
every a. E A. □ 

This result allows us to interpret ux{x) = vx{x) with x E also as the value of the 
discounted infinite horizon problem with state constraint the open set H. We can also give 
a representation of ux that is more consistent with the method of construction by means of 
Neumann boundary conditions used in Theorem 16.21 In fact, the condition dyU = 0 on dVt is 
related with the optimal control of systems for the state equation 


' dXf- = 5(X“', at)dt + ^/2a{Xf -, at)dWt - u{X^ )dkt, X"' = x E 11 
kt = fQldn{X^ )dks is nondecreasing, 


(38) 


where X"' and kt are adapted continuous processes, u is the unit outward normal to 511, 
and Igo is the indicator function of 511. This is a controlled diffusion process with normal 
reflection at the boundary (see, e.g., m)- By Proposition 16.51 if x E H, the trajectory of (1381) 
corresponding to a given control a. ^ A coincides a.s. with the trajectory of (l5|) associated 
with the same control. Therefore the solution ux of the PDF (I33p is also the value function 
of the discounted infinite horizon problem for the system (j38p with trajectories reflected at 
the boundary. 

In conclusion we obtain a stochastic representation formula for the solution pair c, y of 
the ergodic Bellman equation ([3]). 

Corollary 6 .6. Let (usi), dm), m, hold and let vx be defined by dSZ]) with X“' solving either 
© or ([38P . Then the constant c of Theorem \2.S\ satisfies 


c = lim Xvx(x) 
A^0+ 


Vx E H, 


(39) 


and for any x E H, a solution of ([3]) corresponding to c is 


X{x) = lim (vx(x) - vx(x)) 
A->'0+ 


X E n. 


where the convergence is locally uniform in H in both limits. 

The formula (j39D shows a connection with ergodic control, since the limits 


lim AE 
A^o+ 


[/ 


e-^H{Xfi,at)dt 


lim — E 
T-f+oo T 


r l{Xfi,at)dt 
Jo 


coincide if either one exists, by classical Abelian-Tauberian theorems. 
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